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Abstract 

A prescription for constructing dictionaries for cardinal spline spaces on a compact 
interval is provided. It is proved that such spaces can be spanned by dictionaries which 
are built by translating a prototype B-spline function of fixed support into the knots of 
the required cardinal spline space. This implies that cardinal spline spaces on a compact 
interval can be spanned by dictionaries of cardinal B-spline functions of broader support 
that the corresponding basis function. 

Keywords: cardinal spline spaces, B-spline dictionaries, sparse representation, nonlinear ap- 
proximation. 

1 Introduction 

The problem of signal approximation outside the orthogonal basis setting is a non-linear prob- 
lem, per se, in the following sense: Let us consider that a signal / in a separable Hilbert space, 
equipped with an inner product (■, ■) and a norm ||/|| = (/, /)^/^, is to be approximated as the 
M-term superposition 

M 

r = J2c^a^, (1) 

n=l 

where {an}'^=i are fixed elements of a non-orthogonal basis, which if well localized are often 
refereed to as atoms. In order to construct the approximation of / minimizing the distance 
1 1/— /^l I the coefficients cff in ((H) should be computed as c„ = (a^"'^, /), where the dual sequence 
{Q:^}n=i is biorthogonal to {q;„}*£]^, and, in addition, the superscript is meant to indicate that 
span{a„}*£]^ = span{a*^}^£^. Hence, in order to account for the inclusion (or respective 
elimination) of one term in (Q), all the elements of the dual sequence need to be modified 
for the coefficients of the new approximation to minimize the distance to the signal /. Such 
modifications can be performed in an effective manner by means of adaptive biorthogonalization 
techniques [14,15]. However, the problem of choosing the M elements of a non-orthogonal basis 
best representing the signal is a highly nonlinear one [8,9,16]. Since the general problem has not 
feasible solution in polynomial time, in some practical situations it is addressed by algorithms 
which evolve by fixing atoms at each iteration step. These approaches are known as adaptive 
pursuit strategies [2,8,10,11,13]. They operate by selecting atoms from a redundant set, called 
a dictionary [10]. 

*Support from EPSRC (GR/R86355/01) is acknowledged. 
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It should be stressed that, as far as complexity is concerned, there is not much to lose by 
applying the above mentioned practical selection strategies on a redundant dictionary, rather 
than on a non-orthogonal basis. Nevertheless, as has been shown in the context of several appli- 
cations, there is potentially much to win in relation to sparseness of the signal representation. 
Hence the motivation of this Communication: We prove here that cardinal spline spaces on a 
compact interval are amenable to be spanned by dictionaries of cardinal B-spline functions of 
broader support than the corresponding basis functions. 

It goes without saying that splines have been used with success in wavelet theory and 
applications to signal processing [4,5,7,17]. In particular, the construction of multiresolution 
based spline wavelets on a bounded interval is explained in great detail in [5,6, 12]. Here we 
focus on B-spline functions and discuss the way of going from B-spline basis on the interval to 
B-spline dictionaries which are endowed with a very interesting property. Cardinal spline spaces 
on a bounded interval are finite dimensional linear spaces. The dimension is actually given by 
the number d = m + N , where m is the order of the splines being considered and N the number 
of knots in the interval. By fixing the order of splines, the usual way of increasing the subspace 
dimension is to increase the number of knots, decreasing thereby the distance, b, say, between 
two adjacent knots. Let us recall that the basis functions for cardinal spline spaces (B-spline 
basis) have compact support which, except for the boundary functions, is of length mb. Thus, 
by decreasing the distance b between knots, the support of the functions is reduced. With the 
exception of the boundary functions [5,6] a B-spline basis for the subspace arises by successive 
translations of a prototype function. The translation parameter is the distance between knots. 
It is clear then that if the translation operation is carried out with a translation parameter b', 
such that b/b' is an integer, some redundancy will be introduced. However, the main result 
of this contribution is to prove that, by such a procedure, one can generate the span for the 
cardinal spline space associated with the distance b' between knots. We believe this to be a 
remarkable feature of splines, which is potentially useful in relation to signal representation. 
Such a possibility will be illustrated using matching pursuit strategies for representing a signal 
by selecting atoms from our cardinal spline dictionaries. 

The paper is organized as follows: Section |21 provides some definitions and background on 
splines relevant for our purpose. Section El gives the proof of the main theorem establishing 
the above mentioned property of the proposed dictionaries. The potential suitability of such 
dictionaries for recursive signal approximation is illustrated in Section EJ The conclusions are 
drawn in Section El 

2 Splines on a compact interval 

We introduce here some notation and basic definitions which are relevant for our purpose. For 
an in depth treatment on splines we refer to [3, 18]. 

Definition 1. Given a compact interval [c,d] we define a partition of [c,d] as the finite set of 
points 

A = {xi}^J^^, N gN, such that c = xq < xi < ■ ■ ■ < xn < xn+i = d. (2) 

We further define N subintervals Ii,i = 0, . . . ,N as: U = [xj, Xj+i), i = 0, . . . , N — 1 and 
In = [xn, xn+i] ■ 
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Definition 2. Let Um be the space of polynomials of degree smaller or equal to m G No = 
N U {0}. Let m be a positive integer and define 

SrniA) = {f eC^-'[c,d]; f\i, eUm-i,t = 0,...,N}, (3) 

where /|/. indicates the restriction of the function f on the interval li. 

We call S'm(A) the space of polynomial splines (or splines) of order m with simple knots at 
the points xi, . . . , x^. 

Let us recall two well known properties of 5'm(A). 
Property 1. S'm(A) is a linear space of dimension m + N [18, Theorem 4-4J- 

Moreover, it readily follows from Definition |2l that 
Property 2. If A and A' are two partitions of the interval [c, d] such that A G A' , then 

In order to construct a particular basis for Sm{A) it is necessary to introduce the so-called 
extended partition. 

Definition 3. Let A be a partition of [c, d] and let us consider 

yi < y2 < ■ ■ ■ < y2m+N 

such that 

yi < ■ ■ ■ < ym < c, d < ym+N+i < ■ ■ ■ < y2m+N (4) 

and 

ym+l < ■ ■ ■ < y-m+N = Xi, . . . , Xn- 

We call A = {t/jj^IlV'^ an extended partition with single inner knots associated with S'm(A). 

The points in an extended partition A associated with ^^.(A) are uniquely de- 

termined, however the first and last m points in A can be chosen arbitrarily. 

With each fixed extended partition A there is associated a unique B-spline basis for Sm{A), 
that we denote as {-Bi}™"^^. Full details on how to construct such basis are given in [18, Theorem 
4.9] and [5]. The basis functions Bi satisfy for x G [c, d] 

Bi{x) =0 if X ^ bj,yi+m], (5) 

Bi{x) > if X G {yuyi+rn)- (6) 

In the case of equally spaced knots the corresponding splines are called cardinal. Moreover all 
the cardinal B-splines of order m can be obtained from one cardinal B-spline -B(x) associated 
with the uniform simple knot sequence 0, 1, . . . , m. Such a function is given as 



ml ^-^ \ i J 



(7) 



where (x — i)™ ^ is equal to(x — i)™" ^ifx — i>0 and otherwise. If ?/«,... , ?/i+m are equally 
spaced, then 

B^{x) = \b ( ~ 



b \ b 



where b is the distance between two adjacent knots. 

Let as recall that, given a partition A and a real number r by the operation A + r we obtain: 

A + r = {xi + r}^J)^ = {xo + r,Xi+r,. . . , xjy+i + r}. 

In order to retain the boundary points xq and xn+i we define a new operation 'Al+lr' as follows: 

Definition 4. Given a partition A and a real number r, < r < minj(xj+i —Xi), i = 0, . . . , N 
by the operation A\tir we obtain: 

A\Sr = {xi + r}f^Q U {xq, Xn+i} = {xq, Xq + r, . . . ,xn + r, Xn+i}- 

Since we are interested only in cardinal spline spaces hereafter we will consider an equidistant 
partition of [c, d] . Such a partition is thereby uniquely determined by the interval [c, d] and the 
distance, b say, between two adjacent points. It is assumed that the interval [c, d] contains at 
least one complete B-spline function, i.e., d — c > mb. The definition of equidistant partition 
is extended to open/semi-open intervals as indicated below. 

Definition 5. We construct an equidistant partition of [c, d], (c, d), (c, d], and [c, d) with distance 
b between adjacent points (such that [d — c)/b =integer) as follows: 

Vb[c, d] = {c,c + b, . . . , d — b,d}, 'Pbic, d) = {c + b, . . . , d — b}, 

Vb{c, d] = {c + b, . . . ,d — b,d}, ^b[c, d) = {c, c + b, . . . , d — b} . 

As already mentioned, the selection of a particular extended partition A yields a particular 
B-spline basis for S'm(A). Two possible choices for the first and last m points determining the 
extended partition are the following: 

i) The points {yi}^^ and {yi}1=N+m+i determined in order for the whole sequence 
A = {yi}l!^i^ to be endowed with the equidistant property, i.e., A = Vb{c — mb, d + mb). 
Such a sequence is called an equally spaced extended partition (ESEP). 

ii) The points lying outside [c, d] are given the value of the closest point in the interval, i.e., 
yi = ■ ■ ■ = ym = c and ym+N+i = ■ ■ ■ = y2m+N = d. This is called an extended partition 
with m-tuple knots on the border (EPKB). 



3 Building B-spline dictionaries 

For the sake of a simpler notation we prefer to build dictionaries by considering the extended 
partition ESEP, i.e., A = Vb{c — mb,d + mb). The reason is that, since the whole partition 
is then equidistant, we can construct the spanning functions by translation of one prototype 
B-spline of support of length mb into the points = Vb{c — mb,d) and the restriction 

of the functions to the interval [c,d]. This process is equivalent to constructing the boundary 
functions by truncation (see Figure Hj), which allows us to use a simple notation to label the 
dictionary functions. Shifting indices, for later convenience, we indicate the basis for ^^(A) 
associated to the ESEP A as 

{(f)k{x)}keVt{c-mb,d) = {4>{X - k)}keVt{c-mb,d)i (9) 

where = (|). Note that supp(0) = [0,m6]. 
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Since S'm(A) is a space of dimension m + N, it is clear that the dimension can be increased 
by decreasing the distance between knots. The main contribution of the present effort is to 
propose an alternative way of increasing dimension, namely: maintaining the same distance 
between knots and including functions arising by simple translations of the basis function for 
S'm(A). This is established by the following theorem. 

Theorem 1. Let A = Vblcyd] and A' = Vb'[c,d] be such that A C A'. Let us denote as 
{4>k}keVi{c~mb,d) and {(j)'^}keVy{c~mb',d) the corresponding ESEP B-spline basis for Sm{A) and 
Sm{A'), respectively. 

We construct a dictionary, Vm{A,b'), of B-spline functions on [c,d] as 

V>ra{A,b') = {(f)k{x)}keV^,{c-mb,d)y (10) 

for which it holds that 

span{P„(A,6')} = ^™(A'). (11) 

Note that the number of functions in the above defined dictionary is equal to the cardinality 
of Vb'{c — mb, d), which happens to he K = {d — c + mb)/b' — 1. Before advancing the proof of 
this theorem let us assert the following remark: 

Remark 1. Setting p = b/b' — 1, for < i < p, we have 

Sm{A W ib') = spaii{(j)k{x)}ke{Ptlc-mb,d)+ib'} = span{0(a; - {k + ib'))}kePtlc-mb,d), (12) 

p 

Vb'{c - mb, d) = Vb{c - mb, d) U |J{P4c - mb, d) + ib'}. (13) 

1=1 

Hence, an alternative definition for the dictionary Vm{A, b') , which is equivalent to (|Tn|l . is the 
following: 

p 

Vm{A, b') = {(f){x - k)}kevt{c-mb,d) U |J{0(a; - {k + ib')}keVt[c-mb,d)- (14) 

i=l 

Moreover, from (fT^ and (HH), it follows that 

p 

span{P„(A, b')} = [j 5^(A W tb'). (15) 

We are now in a position to start the proof of Theorem ^ 

Proof of Theorem{J\ We will use (IT^ to prove that S'm(A') = span{r'm(A, b')}. 
The inclusion S'm(A') D span{Vm{A, b')} follows from (fT^ and the fact that, from Property|21 
Sm{A), Sm{A l±l 6'), . . . , Sm{A 1+1^6') C S'm(A'). We can then construct scaling-like equations by 
expressing each function (pk G Vm{A, b'),k G Vb'{c — mb, d) as a linear combination of functions 
(p'n G ^^(A'),^ G Vb'{c — mb',d). Considering the support of functions (pk we introduce the 
scaling equations by grouping them into three classes: 

0fc(a;) = ^ /in,fc0Ux) ioi k e Vb' (c - mb, c) , .Jl = Vb'{c - mb' , k + m{b - b')], (16a) 

neJL 

0fc(a;) = ^ /i„,A:0^(x) hi k e Vb'[c,d - mb], Ji = Vb'[k, k + m{b - b')], (16b) 
(l^k{x) = ^ hn,k(p'n{^) for k eVb'{d- mb,d), J^ = Vb'[k,d). (16c) 

neJR 
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Equation ()16ap describes the left boundary iunctions, i.e., all the functions which have support 
of length smaller than mb and contain the point c in their support. Equation ()16b|) describes 
the inner functions, which are functions of support of length mb arising just as translations of 
a fixed prototype B-spline function. Finally, equation (jl6c|) corresponds to the right boundary 
functions, which have support of length smaller than mb and contain the point d in their 
support. 

The proof of the inclusion S'm(A') C spa.n{T>m{^,b')} will be achieved by showing that 
every 0^(a;) G S'm(A'), n G Vy{c — mb', d) can be expressed as a linear combination of functions 
0fc £ ^^m(A, b'),k G Vb'{c — mb, d). For such an end we find it convenient to merge the equations 
(jl6bjl and (jlfic|l . Notice that (jl6b|l and ()lfic|l can be recast as: 

(Pkix) = ^ /i„,fc0^(x) for k G Vb'[c,d), Jr = Vb'[k,d). (17) 

Now, since Vb'{c — mb',d) = Vb'{c — mb',c) U Vb'[c,d), in order to decompose every function 
n G Vb'{c — mb', d) in terms of the broader functions 0^, k G Vy^c — mb, d) we make use 
of (fT7|) if n G Vb'[c,d) and ()16a|) if n G '^^'(c — mb',c). The steps leading to the required 
decompositions are spelled out below by focusing on the case n G Vb'[c, d). 

Let us recall that each function 0^, k G Vb'[c, d) is supported in [k, k + mb] fl [c, d] and that 
0fc|[fc,fc+6'] = ^A;,fc0fc|[fc,fc+6']- Hence one can be certain that the coefficient hk,k in ffT7|) is non-zero 
and use this equation to express ^^(x) for k G Pb'fc, d), as: 

= T^0fc(^) - E T^<^n(^)- (18) 
Ilk k III. k 

' n&Vy[k+b'4) 

The proof that for all / G Vy [c, d) each function (f)[ (x) is expressible as a linear combination 
of functions 0a:(x), A; G 'Pb'['^, (i) follows by subsequent evaluations of (fT5|) at the explicit values 
k = 1,1 + b',l + 2b', . . . ,d — b'. Indeed, for k = I we have: 

III I ' III I III I 111 I '—^ III I 

neVy[l+b',d) ' ' ' ne.Vy[l+2b' 4) 

(19) 

and the recursive process evolves as follows: The first step entails to evaluate (|TH|) at A; = / + 6' 
and introduce the corresponding expression for 0;_,_j/(x) in (fT^. Thus we have: 

N ^ ±1 \ hij^h',l , / N , V;^ f hl+b' ,lhn,l+b' ^n,l\ , N fr,n\ 

(Pii^) = l-U^) - 1—r (Pi+b'{x)+ 2^ -7— r -j—jKi^)- (20) 

1^1,1 l^i,m+b' ,l+b' nepj\i+2b' d) ^ '^''^"■'+^'.'+''' / 

The next step consists of evaluating (fTRjl at A; = / + 26' and introducing the corresponding 
expression for 4>'i^2b'i^) pHj) . The process continues repeating equivalents steps, i.e., at step 
s say, we evaluate (fTHj) at A; = / + s6' and introduce the equation in (j^ . Finally, at step 
{d — b' — l)/b', for k = d — b' we obtain: 

<P'd-b'ix) = T-^ ct>,.b'{x). (21) 

i^d-b',d~b' 

When 0^_^,(x) as given in (PT|) is introduced in (pUj) . the right hand side of this equation turns 
out to be a linear combinations of functions (t>i{x), (j)i+b'{x), 0/+2fe'(a;), . . . , (l)d-b'- We have thereby 
proved that 4>'i{x) G span{T'm(A, 6')}, / G Pb'[c, ci). 
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The proof concerning functions 0^(a;), n G Vb'{c — mb',c) parallels the proof given above, 
but the following considerations are in order: To obtain the corresponding equation for 
we use fjl6a|) and the fact that hn,k 7^ for A; = n — m{h — h'). The required decomposition arises 
by evaluating such an equation at values of k in decreasing order ranging from k = n — m{h — h') 
to k = c — mb + b'. □ 

Corollary 1. The dictionary Vm{A,b') = {(f)k{x)}kev^,{c-mb,d) is a frame for Sm{^') , i-e., for 
all f G ^^(A') there exist two constants < A < B such that 

m\\'< E \{fAk)\'<B\\f\\'. (22) 

kaVy {c—mb,d) 

Proof. The proof is a direct consequence of Theorem^ since the dictionary "Dm (A, b') is a finite 
dimension set of functions of finite norm and, as such, a frame for its span. The upper bound 
is a consequence of Schwartz inequality and the non-zero lower bound is ensured by the fact 
that for / G S'm(A') it is true that (/, (pk) 7^ at least for one k in Vb'{c — mb, d). □ 

Remark 2. It is appropriate to point out that, although the proof of Theorem^ was given for 
dictionaries constructed within an ESEP setting, the result can he extended to more general 
extended partition settings. The corresponding proof is equivalent to the one given here, hut it 
involves a less handy notation. 

Figure ^ shows some examples of B-spline dictionaries. The top graph on the left depicts a 
B-spline basis of order m = 1. These are piecewise constant functions and, since there are not 
boundary functions, the ESEP and EPKB basis are equivalent. The corresponding dictionary of 
functions of double support is depicted in the top right graph of the same figure. As emphasized 
by the thicker lines, the dictionary contains two boundary functions of support equal to the 
basis function of the left graph. The middle left graph of Figure [T] shows the B-sphne basis of 
order m = 4 corresponding to the ESEP extended partition. The middle right graph shows 
the dictionary, for the same space, consisting of functions of twice as much support as the 
corresponding basis functions. The graphs at the bottom have the same description as the 
middle graphs, but correspond to the EPKB extended partition. 



4 Application to recursive signal approximation 

We present here two examples to illustrate the relevance of the proposed dictionaries to a typical 
problem of signal representation: the problem of achieving a sparse atomic decomposition 
approximating a given signal. 

As a first example we consider the randomly generated blocky signal on the interval [0,4] 
depicted in the left graph of Figure El Such a signal has an acceptable approximation in the 
subspace 5*1 (A'), with distance between knots b' = 2~^, spanned by a B-spline basis of order 
one. The graph indicating the signal approximation coincides with the one of Figure |21 For 
such an approximation we need to use almost all the basis functions (956 out of 1024). This is 
of course an expected result, since the support of the basis functions for 5'i(A') is considerably 
small (|supp I = 2^^) in comparison to the length of the blocks composing the signal. It is 
then convenient to construct the identical approximation using dictionary functions of much 
larger support (| supp | = 1) spanning the same space S'i(A'). In this case the approximation 
is obtained by means of only M = 23 functions, chosen through a forward and backward 
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Figure 1: Examples of bases (graphs on the left) and the corresponding dictionaries consisting 
of functions of double support. The top graphs correspond to B-splines of order m = 1. The 
middle and bottom graphs involve B-splines of order m = 4 and ESEP and EPKB settings, 
respectively. 



optimized orthogonal matching pursuit strategy [2,13], from a dictionary of 1279 atoms. For 
further comparison we have used the Haar wavelet representation for the same space, which 
contains wavelets of varied support and scaling functions of the same support as the dictionary 
functions. Since Haar wavelets are orthonormal, to obtain the desired signal approximation 
we need just to retain M = 50 basis functions corresponding to the 50 coefficients of largest 
absolute value. 

The second example involves the piece of modulated chirp signal plotted in right graph of 
Figure El This signal has an acceptable representation in the subspace 5'4(A'), with h' = 2~^, 
spanned by the B-splines basis of order four. Since in this case the basis is non-orthogonal, 
in order to approximate the signal by a subset of basis functions we applied the same pursuit 
strategy as in the previous example. An approximation coinciding with the graph of Figure |21 
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Figure 2: Randomly generated blocky signal (left graph). Modulated chirp (right graph). 

is obtained with M = 101 basis functions. Using a dictionary of functions having four times 
larger support (i.e., distance between knots), and the same matching pursuit strategy for 
selecting functions, we need M = 58 dictionary functions. In this case, the selection from 
the wavelet representation of the subspace needs to be carried out also through the matching 
pursuit approach. The required number of wavelet functions is 61. 

It is interesting to notice that in both examples we have achieved representations which in 
terms of sparseness are comparable (superior in the first case) to wavelet basis representation. 
This is a surprising result, since wavelet basis are composed by functions of different support 
and our dictionaries by functions of fixed support. These outcomes are certainly worth to be 
investigated further. 

MATLAB codes for generating the proposed dictionaries and implementing pursuit strate- 
gies are available at [1]. 

5 Conclusions 

An interesting feature of B-spline functions ha s been discussed. We have shown that a dic- 
tionary for a cardinal spline space on a compact interval can be constructed by translating a 
prototype B-spline function into the knots of the corresponding space. This property allows 
to span a cardinal spline space by using B-spline functions of larger support than the one 
corresponding to the basis functions for the same space. 

As an example of application of the proposed dictionaries, two signals of different nature 
have been represented by selecting atoms from dictionaries of B-splines. The results illustrate 
the possible relevance of B-spline dictionaries to problems requiring sparse representation. 

Finally, we would like to point out some lines of follow up work that we believe to be 
interesting: The possibility of spanning a fixed space by B-spline dictionaries, each of which 
consists of functions of different support, arises the question as to how to choose in a effective 
manner the dictionary of B-splines of 'optimal support' for representing a given signal. Another 
matter that appears definitely worth looking at is the possibility of extending the proposed 
construction in order to generate suitable subspaces by translating wavelets generated by B- 
splines. 
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